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Jn a' 1979 survey, .the maiority pf the 7 3% responding 
pupferintendents -and ^8* responding school board chairmen in 269 
randomly chosen small school districts across*^ the nation indicated 
tha*- 'program evaluation activity cccjurred in their di^st^icts and that 
evaluation information was generally desired by and available' to the 
school board. Superintendents and chairmen similarl-y viewed 
evaluation as:»continuous monitoring of ongoing programs (b^-rbbt) : 
asse-ssmen* of student progress ( 32- 37 fr: and accountability (23- 32%) , 
Jup'^under haLf o,f the school board chairmen reported regular 
currlc!Hum evalua^hion and 92'f*reported some. Much of the existing 
evaluation activity was constituted bv standardized testing programs,, 
available in of theMistricts*;;^ and was conducted by distrifct 
f<+-aff personnel such as pri!^cipals of guidance counselors,' Pesul"t)ing 
information was used mainly 1 0 . det-ermine the future of ongoing 
program*? (65^?) and the need for new programs (35%), While i<MX of 
board chairmen were satisfied with the amount of evaluation 'mat^ial 
they received, 5151 nanted more although the maiority of districts had 
no policv regarding pragram evaluations,' Although nearly half ihe 
chairmen reported spendfng lesfe than 10% of board time on curriculum, 
not unlike larger districts, there was nonetheless arf overall 
positj. ve ' reception of and intended use of evaluation material. 
(SB) • . ' ♦ . 

* Peproduct^^ns supplied by FDPS are the be-^t ;that can be made * 

* ' from the original document* ' * 
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BKECUTIVE SUMMARY 



Small School District Utilization of Program Evaluation 



n Evaiui 



Surveys were received from 218 superintendents (73 percemty and 113 School 
Board Chairmen (38 percent) in 296 school clistricts with student enrollment of 
1500 or Jess across the nation. About one-half of the school board members 
w^e from districts of 500 or fewer, students. 

The survey show^ there is evaluation activity (broadly defined) occurring 

in smAll school districts, and that in most cases school boards have access to 
the information. Superintendents and board members have similar views of the 
meanincpof evaluation: A continuous monitoring of ongoing programs (54 to 65 
percent), the assessment of student progress (32 to 37 percent), an^ 
accountability' (23 to 32 percent) . About a third report that their states 
have laws and regulations about program evaluation. . > - 

• ^ " 

'Seventy percent of superintendents report that evaluations are conducted on 
title programs in their, districts. Approximately half report that evaluations 
of federal programs, state programs, districtwide progr.ams and individual 
school programs ar'e conducted. Eighty-four percent of districts have 
standardized testing programs. Two superintendents report no- evaluations are 
qdhe in thier districts. Just under half of the board members report that 
'^regular" curriculum evaluations are conducted; 92 percent report som^type of 
eyaltiation actifvity. 

Forty- four percent of board members are satisfied with the present amount of 
evaluation information they receive. Fifty-one percent would like more 
evaluation information. The majority of school board members (85 percent) 
foel that the evaluation information they receive is presented in a manner 
*uSeful to them. Superintendents rate the evaluations conducted in tl^eir 
districts as "good" (54 percent) or "fair" (31 percent). Most superintendents 
(70 percent) report that the school districts request information relating to 
program evaluation^ and a like percent of board members (73 percent) say they 
request evaluation information. The superintendents feel that information 
gathered through evaluations would help them communicate better with their 
school boards. They listed many additional types of evaluation they would 
like to conduct if the resources were available. 

According to 75 percent of the superintendents, the person conducting the 
program evaluations is a district staff person. Of those, 40 percent are 
fulltime, though not necessarily fulltime on evaluation* responsibilities.- 
M6st often\f the responsibilities ar6 handled by a principal (36 percent) or a 
gurdancG a!^unaelor (33 percent) who may or may not have any specific training 
in program ^evaluation. School districts receive evaluation assistance from 
their state^ departments of education (5^ percent) except in Region 10 of the 
country (Aldska, Idtiho, Oregon and Washington)., where most often assistance 
oomes from the education service districts. \ V 
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Si«ty-».8ix percent of boards report they do not havfe a policy for program 
evaluation. Of the 26 percent who state that they do have policy, they 
^ ocwnmented that it was a sthto mandate or a district polip'y. None were willihg 
td. state or enclose a copy as requested. 

The two most frequent uses of evaluation information are to determine the 
future of ongoing programs (65 pei;cent) and to determine the need for a new 
program (35 percent) as reported By board members • . Nineteea percent say 'that 
they use program evaluation information to set policy. . * 

.Just under half report that they disseminate program evaluation information to 
patrons, particularly parent groups such' as advisory councils; PTOs, school 
staff ar>d the media. The information is disseminated most often at school ' 
board meetings and through the newspaper. The school newsletter and "word of 
mouth" are also used to provide information about program evaluation. 

Those schoof board members, who^feel the, need for more evaluation information 
•think that the information would be helpful In ma King program decisions (51 
percent) • ' 7 

Forty- two percent of the Board ^^embers estimate that they spend 0 to 10 
.percent of their board time on curriculum; 29 percent of board chairman 
estilnate 11 to 25 percent of board t'lme. Since there ar e .cur r iculum matters 
Which do not necessarily involve evaluation results, it is assumed that the 
boarcJ time spent on curriculum evaluation is less than the estimates in 
response to this question. 
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"All materials associated with the 'Small -Schools Survey on Program 
Evaluation ' were developed by the Northwest Regioilal Educational Laboratory 
under a grant (No. OB-NIE-78-0206) from the NationalyIR9l>d.tute of Educa- 
tion and with assistance from Education Res9urces Information Center, 
Clearinghouse' on Rural Education and Small Schools uftder contract (No. 
NIE-400-78-0023) from the Nati6nal Institute of Eduction. Content of 
the^e materials does not necessarily reflect the position of policy of 
these agencies, and no official endorsement, of these materials should 
be inferred." * 
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Introddctioo and Purpose / \ • . ^ 

For a long tiine^^ definitions of educational evaluation hav0^ stressed the 
importance of evaluation reports and' outcomes to decision makers* Worthen and 
SandetSf (15) ^ distinguish between research and evaluation quoting Tukeyr 
(14) ^ and Cronbach and Suppes^ (2)^: 

Research seeks conclusions y evaluation leads^. to ^ecisipns . The' decision 
maker believes he nefeds information to^ guide his actions and he poses, the ^ 
questions to the Investigator. ,^ V 

"iiip are the educational decision makers? At the top are \.he local school 
board and the school district superintendent, referred to in inany places as 
the management team. 

In larger districts, administrative staffs in the central office help the 
superintendent compile information on all topics (including, of course, 
curriculum or program evaluation^. But what happens in the smalleu: school 
districts7v Thoise are the districts where the superintendent njay also be a 
part-time principal, or where the schooj. boatd members may outnumber the 
number of teachers hired. Does program evaluation exist in these districts? 
Is it used? 

* « 

th^re is some evidence that school board members even from larger districts do 
not have access to, or do not use, much program evaluation information in . 
making'their '^ec^sions about programs' within the district, (1), (5). And yet 
they are the districts more likely to have extensive program evaluation, 
certainly more than small school (districts with limited staffs and resources. 
Although a school district is small, it has no less need for evaluation 
IViformation. However, its methods for , obtaining s^ch data are dbviously 
different* ' . 

Ihe objectives o^ this study are to describe existing program evaluation in 
small schodl^^tricts and to describe current utilization of available data 
relevant tt^^^Ryation in these .districts. I.t wiH seek answers to the 
following questions: . * * ^ 

-1. Do small school districts perceive a need for program evaluation? 

2. What kinds of information do thej^ use for program evaluation? . 

' r ■ ' ' . ■ - 

3. How are program evaluations con^uct6d? 

^ 4. Mow is existing data (which may be collected originally for other 
purposes) utilized? 
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. Litj.erature Review ^ 

♦ * .* 

A redent publication, Imafciinary Gardens? Real Problem^, An Analysis bf. 
Federal Information Sources prv-Rural Education , stated that the ^federal ' ' 
effort to coordinate data from various agencies oftep excludes the collection 
of data on schools with fewer than 300 ^students' «nd ^chool districts with 
fewer than 1000 students," (8)'. Accordi^ng to 1977 statistics, 54% of all 
school districts in the i?^tion have 1000 or lesis students, (12). Since this' 
represents only 6.9% of aU students ^ the federal neglect of rural schools (by 
nature, also small) which Jonathon Sher, (10) describe's is not surprising. It 
seems a case of economics - utilizing decreasing ^'unds to maximirze student 
benefits - and that' includes data collection. 

In. the last two years, ^owevpr, ther^ seems to have been a push at the federal 
level to rfemedy this neglect, (9). One such effort is the "Keys to School 
Boardsmans hip" project which is part, of the total Rural Education Program at . 
t>ie Northwest Regional Educational Laboratory. This study concerning the 
.utilization of evaluation in small school districts was conducted as part of\ 
that project. ' \ ■" - ^ 

A literature search Surfaced accounts, of evaluations of specific projects in 
sm»ll or rural school districts, but none addressed the issue ot utilization 
of results. Ten years ago Cuba, (4), observed, ' "evaluation has had little 
influence on educational decision-making and evaluation information is largely 
ighored." Efforts are presently underway to determine if time has changed 
that situation. A project entitled "Evaluation and Decision-Making in School 
Districts" at the Center for the Study of Evaluation, (13), is studying 
centralized program evaluation unit^, identified in school districts enrolling 
5000-plus students, in an attem^ to understand their development and 
functioning, as. well as to note thfeir irregularities and peculiarities. One- 
area of in<3uiry is "Who uses evaluation .'information?/* , " 

Recently, Al kin' and Daillak, (1), reported ^n their efforts as part o^ the 
project, "Evaluation and Decision-Making at the Progreun Level."-, They used a 
case study method to. determine what influence evaluations had on five 
different school programs - two Title I and €hree Title IVC. They foqnd that 
while none of the evaluations had "make or break impact upon the program it 
assessed," the evaluations did have' influence upon the decisions made by local 
program staff. The information in one case influenced teacher behavior and, 
in another, was used - very modestly - to identify program strengths and ' 
weaknesses, in only one case study did the evaluation information result in a 
major program decision. - \ 

In a study on the role of school boards* involvement" in school self-s<:udy 
evaluation, Smith's dat«k, (11), suggested that only about 60% of the ' 
evaluation recommendations were subse^guently implemented by the school 
boards. In this case, board members and school administrators rated the 
quality of the evaluations higher than the quality of ".the recommendations 
which the results suggested. 
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An article by a former school board president, RiQhard L. \Johnston, (6), 
.alluded to the reticence of school bbards' "tampering with carticulums, 
instruction, or personnel matters" due to the difficulty of obtaining relevant 
information (program evaluations). 

In order to learn more about the issue of small district evaluati'bn tesources 
and evaluation utilization, the authors questioned superintendents and school 
board chairpersons in small s^ool districts (1500 oif less students) across, 
the counter y. • ■ '.'-^ 
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^ Survey Development: ^ , \ \ 

The survey-began w4th discussion of need arid^a^ iist of topics to'be addr_ 
. by. questions. A draft .or questions was then"!' prepfeired, discussed by the t 
developers and revised. The revised list of . questions was reviewed by 
project staff' of the Boardsijianship jprojl^ct and by two evaluators wottci 
^different projects within the Northwest Regional Educational Labor ato^ 

After reviews, the questionnaires were again revised, and put into the 
Dillman's Total Design M6thod form. In order to keep the questionnaire to one 
page folded,, it was decided not to use a cover design, but to begin, the 
questions on the first page. Copies of the surveys are found irt Appendix A. 

Because of limited time and efforts, trying to avoid sending out surv'eii^s 
during a holiday period, the surveys were not piloted. The.revjLews mentioned 
above served as a pilot. ' " 

A "modified" Dillman technique was used to prepare and send out sCirveys.' 
Dillman explaj,ns in detail how to achieve good response from mail surveys^. 
.Points in Diliman's survey method which were used include: 

1* Size of survey form. ^ 

2. Booklet form; . » 

3. Type format of questions (stem ip mixed type, response' options in all 
capitals) . " ' . * <, • 

4. • Cover letter content. 

5. Follow-up postcard one week after original mailing. 

6. Mail data early in week (Tuesday). 

7. Avoid holiday 'periods. 

* 8. Follow-up letter and a,uryey mailed out three weeks after original 
mailing. ' . ' ' ' 

9. Follow-up letter plus S'urvey seven weeks after original mailing. 

' 10. Inform respondents of numbering systen. 

Modifications to Dillman' s TDM included: - ' 

1. No cover design for survey. 

2. No seven-week follow-up mailing. _J 
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Sampling 



The number i>f school districts to be included in the sample was to be 
determined two ways: ' The siample had t9 |e>e large enough to draw some ' 
Gonclusiofirf^; but small einough to be affordable fqr the multiple mailings. ' 
Superintendents and School Board Chairs were to *be/ surveyed^ so* there were two 
Initial mallihgs for each dli^trict. Follow-up mayilinijs were -als6 included in 
cost esftimation*"^ Three hundred- school districts were determined to be a 
Sample size which met both crjLteria — a sufficiently large number and possible 
within ^the allowjed. budget . The actual Sample size turned out to be .296 T 
districts. * * % • 



The ten HEW re^jSj^pns Were used to determine regions of the country." From The . 
Public Education Directory for 1977-78 ^ which contained a listing of all !. 
school districts in the country by enrollAient , size , 'aj-l school district^ which 
had ISOOxStudenttf or less were identified. From this list^^the numb^fet/df ^. 
distrlfets in' feach region was determined k ^ For each fegioj!, a perc^ntag!? of tjje 
small s^Qhool dis^iUcts ih the nation wap calculate^d. *Based on this 
proportion, the appropriate number of flietricts. f^ the Region that' should 
rn6Xude<3 in*^ a proportional sample could ^be* determined^_JCJstng these figures, Ikj 
random sample was selected jErcHu each region. For ,t)ie random selection^, the"" t 
Curriculum Infbrpatipn Ceater; Inc. School Directory was used becausfe. it 
contained jSata based on ^977-78 enrollmenttand was* the most cur rjent directory) 



available 4 



:^ curr^r 



At the point of constructing the * random; sample, it was * noted thht oonsali- 
dation had taken plac^ irr^one region of the Coventry using the updated- * ^ 
figures. It >h4s then necessary to recalculate the correct^ proportion for eacli 
region* It should be noted that some sta^es were lieft out originally, such as] 
Hawaii^ which has only one 'di-sttict in the state ' (obviously ^more than 1500 ' 
. students) >. Other stated were not included: in the sampling process because/ i 
they had such a small number- of di^tr^Cts with fewer than 1500 students that i^ 
they did w>t show up using randqiv sampling techniques by region* For example, ; 
Florida has five districts with fewer than 1500 Students, Delaware two. New * 
Hatfnpshire seven, West Virginia one. Obviously/ the way that a state has or ^ 
has not consolidated its small districts has a beatlng^on this sample. The 
proportions were based on the number of small school districts in the state x 
and region, not on the population o^^ proportion of students in a jstate or 
region. The number o£ districts by state and region, are shpwn i n*^ Appendix B. 
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♦ . , • Schedule 

.Survey^i with cover JLetter wi^re mailed to total sample of school board members'^ 
and superintendents on October 16, 1979. ' • , . 

A follow-up postcard was sent to the total sample on October: 23rd r one week 
aftei[ the first mailing. A follov^-ap letter with a copy of th^ stftvey was 
sent to tho^ whose responses had not be^ received by November 5 (three weeks 
*fter thisi^tfriginal mailing).. Response cut-off date Was December 12, "t919. 
Copies of the letters and post cards are included as \Appendix C. 

.. . , ■ • / ■ • '. 
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Response 



Of the 296 Superintendent surveys mailed ou€, 218 completed surveys were \ 
, received, a 73% return. Of 296 School Board Cha£r surv^s, 113 completed 
surveys were received, a 38% return. This was about half of the numbei; of 
superintendent responses. When the sample was Compiled, natnes and addresse^ • 
of superintendents were available, and surveys wer^ mailed to the 
superintendents' offices. However, for the School Boar 4 Chairs, separate* 
addresses were not available, so they were also sent; to the Superintendent's ' 
off ica- This meant that the Superintendent had to cbntact the School Board 
Chair, or the survey had to wait until the next Board meeting or "until t^he 
next time thit the School Board Member was at the School District office. It 
is not known how many of the mailed surveys actually reached the person for 
whom they were intended. • In addition, names of the School Board Chairs were 
not available for all diatricts in the sample. Efforts werelPkde by telephone 
to obtain names, but there wfere a few for whom no name w'ias s^vailable, so that 
the surveys were n\ailed to "School Board Chair" in, care Of the school 
district, pillman's Total Design Method emphasizes personalizing surveys 
whenever and wherever possible. The impossibility jof assijcing that every 
school-board member's name was correct may have alsjo hindered t<je return rate 
for ^ the school board member surveys. . ■ / 

The superintendent' returns were distributed by regioh ;jrery clbsely to the 
distribution of the survey sample. Ninety percefiit of the respojiSlrflg 
superintendents reported four or less schools in^thfe district ^Ith .40% Of the 
returns ccxning from districts with only one School. Eight-two ^fer cent of the 
respondents reported less than 1000 students in their district^.-. v 

The board member returns were not proportioned as the original survey sample. 
Larger proportions were received from Regions 9, 7 and 10, and a smaller f 
proportion from Region 6b Forty-nine percent of the responses were from board 
members whos.e districts have ^00 6r less students^ One-third- were from 
districts with 500-1000 students. Survey i?esponse by regibn and state are' 
included in Appendix B. . . 
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Tabulajblon .and Computer Analysis Procedures 

Data%>/ere analyzed by computer using Statistical Package for the Social 
Sciences. I^perintendents' responses were analyzed as a total group 
(Frequencies) and by region to note differences^ if any (Cross tabs ) . Board 
member responses were analyzed as a total group and by region and size of^ 
distctct, V 



Results' weiJie number and percentage of ^tal N responding to each item. The 
analysis was run on fewer than the toteil number of responses received* Totals 
in the oomputei; analysis were 1Q8 board members and 216 superintendents. A 
few respondent's sent the survey back blank; some completed it partiallyr as 
the ope board member who oo^ented: 

••thi^s school district main\gdj^ one of. the few remaining one-room^ one teacher 
schools in the State of New York - or even in the odfefntry. One teacher oov^ers 
grades 1-4. Consequently^ most of the questions are. ridiculously 
inappropriate. ' Question 16 ^ for example^ provides (as a minimum) '500 or 
less.' We have less than 100 - and in .the _____ School itself, less th&n 
10. Also, in addition to the fact that there is but one teacher, I am the 
Sole Trustee. J do not talk to myself, and that, therefore, eliminates 
several more questions. Kindly remove us from your mailing list. P^S. Nate 
that we do not even -hine a secretaryl" , 

One superintendent telephoned tq express his disapproval of the survey,* then 
preceded* to answer the questions In detail andf express a need for more 'program 
evaluation In his district. He was not ooOlnted in responsef or in the oompMter 
analysis. ^ . • , , * 

' ; \ 
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Results 



As mentioned" earlier r about one^half of the responding board members were fran 
districts with less thin 500 atudfintsj and about 90< of* -the superintendents 
reported four or few.er schobls, with 40% reporting Qnly one school, Coitiments 
attached to the survey forms indicate OftAes where the iguperintenddht is also 
the teacher, in order ^to ^better understand and interpret data about their 
utilizatior^of evaluation results, information was requested on the survey 
forms to indlcjjte what evaluation means to these small school district 
officials and how much evaluation is taking place ifi.these distribts. 

Results indicate that superintendents and board mehbers hold similar views of 
what evaluation i^. To most ofithe^ it means a continuous monitoring of 
on-going progcaras' (Superintendents - 65%, Board Members - 54%) and, to a 
lesser degree, the* assessment of student progress (Superintendents - 37%, 
Board Memhjers - 32%) arid accountability (Superintendents - 32%,^ Board 
Members - 23%) (Table 1) . . ^ > 

Thirty-four percent of the superintendents and thirt^y percent of board members 
say that their states have laws-euid regulations about program evaluation. 
When asked what types of evaluations are conducted in tfceir districts, 70% of 
the superintendents Reported evaluation of title prograHs. Approximately half 
indl.c«te^that evrjr^uatlons df federal programs, state programs, distrl<3t-wide 
programs, and Individual school programs are- conducted (Table 2). Most 
districts (84%) have district- wide s tandardi zed > testing programs. Half of 
those districts' testing, programs include botti elementary and se<?ondary 
schools (elementary only - 31%, Secondary only - 2%) . The variety ahd usage 
of btests administered is shown in Table 3. Only two superintendents 'report - 

that no evaluations are done in their districts. 

■ " ■ . *• ■ . 

The survey requested 'board in§j»bers' perceptions o'f tjhe amount of currieul^'um, 
bvaluation activity occurtXng in' th^sir districts. Less than half (44%^) r«por/ 
that "reguiar" curricul"um , evaluations are conducted.' However, 92% report sqine 
type of evalu«ition activity -/from " regular" "to "yes, sometimes." Only oney 
t>oard member Reports no evaluatljon at alL (Table 4).. .Eight percent report/ 
evafluation is done "only in unusual circumsbances ,", and 15^* «?knly to oomplj 
with federal or state regulations,. 

,Porty-four percent of board members lare satisfied with the present ampia/t of ; 
evaluation Information ^hlch they receive. About half (5i%) would lik^ more' 
evaluation information. The board members 'who per9eived little or no 
curriculum evaluation occuEring in trieir 'districts attribute this lao/' to 
personnel's having other higher priority r es pons ibii^i ties and lack ol 
resources (Table 5).' ^ ' 

The survey attempted to discover Who conducts evaluations in the^e^/districts 
whose si zff prohibits large^staf fs. TVee-fourths of the superihtehdertts 
report that thefe is a staff person inUheir district resporisible/f or 
•evaluations. In 40% of those cases th^ staff person is fulltime/ this does 
nof» necessarily imply full t;ime qn evaluation. Where the person/tesponsible 
for evaluations has other responsibilities, he/she is more oftenf a principal 
(36%) or ^uidancd, oounse^r (33%). 'Classroom tjeacher 8, are resf^nsibl^ for 
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TABLE 1 



What does school or program evaluation mean to you? 

' ' 1 , ■ J ^ 



o ^ 



ACCOUNTABILITY? 

CONTINUOUS MONITORING OF ON-GOING PROGRAMS?^ 
DECISIONS FOR CONTINUATION OR TERMINATION? 
ASSESSMENT OF STUDENT PROGRESS? 
COMPARISON OF DIFFERENT TYPES OF PROGIiAMS? 
OTHER? 

(Aiirl of tjhe above) 



V 


• Responses to Meaning of Evaluation 


Superintendents 


Board Members 


32.4% 


23.1% 


65.3% 




22.7% 


14.8% 


36.6% 


v32.4% 


"9.f% 


7.4% 


7.4% 


3.7% 


9 


(3.0%) 



TABLE 2 



Superintendent: .Types of Evaluation Conducted In District? 



Federal JPrograme 

: •••• : . / ■ 

Title Programs - ^ 

State Programs . 

V ' . 
Accreditation . 

* (] ■ 

Dlstrlct»-Wlde Programs 

Individual School Programs i 

None 

lOther 

— • • . , 



Percentage 
Responding 



70% 
56% 
48% 
57% 
567„ 
1% 



V 5% 



i ■ 



TABLE .3 



Do you. have a dlstrlct-wi/e standardized testing program?- 



Test 



Number District's 
• Using Test 



Achievement 5 

ACT s 2 

^ ASUAS • \ 

A^Vkh 2 

BSA . 1' 

<CA Reading' Test 1 

CAP . - ' 1 

CAT ' ^23 

• .College T&st of 1 

Mental Ability 

CRT ; ' . 1 

Y CfBS 29 

'•\'DAT • . ' 4 

Diagnostic Test 1 

' ETS ' i 1 

- Gates-MacGin^te 1 

GVR 1 

ICRT X 1 

IND ■ . ^1 

• IQ ■ . . 4 
ITBS , 35 
ITED 15 
List of .Broadrainded ,1 

Progress ' ■ '" • 



Test 



Number Districts 
Using Teat 



• MAT 
MBS 

Metropolitan 

N-Abels 

NEDT 

NMSQIT- ' 
Otls-Lennon 
'P'eabody Achieve- 
ment 
PMA- 

PSAT \ 
SARI 
SAT ' 

SCAT [ ' ■ ^ 
Several. Tests' 
SFTAA ' ' ■ * 
•SRA 
STAS 

State Test Only 
STEP ' - 
Statewide 

Assessment 
TAP 

vVocational i 
.1 



3 
1 
12 
2 
2 
1 
5 
!• 

1 

. 8 
1 

36 
1 

.1 

"2" 

,37^ 

2 
^ 1 
11 

1 



.N=210 



12 



O 1 



TABLE 4. 




— ' — ^ ' ^ ^ L 

Bod^td Member: Does yojur district conduct Qurriculum 


evaluation? 


l~« * 

Percentage ^ 


«• . ' * 
Yes, regularly . . 






Yes, to comply* with federal/state regulations - ,oniy 


s 


• 

15% 


Yes, som^li^imes \. ■ r - ' 




33% 


Only in unusual circuifistances ^ . , 


> r 


♦ 

. 8% 


• • 

Not at all : . 

■ ' • . ;^ * 


% 


VA- 


Don't know * * 

4 ■ . ' ^ ^ 

~ — ' ■ — *- ^ ^ * 







» * 

Does the sqhool board want more. or less curriquium^ 
evaluation information? . ' 



If you do not have cjurriculum. evaluation in your 
; district, what are the principal reasons? * 



' Satisfied With 

. More Less . Preserit- Ama'unt 

. 50.9%^. '1.9% 43.5% 

— -. — ^ — ^ --^ . . 



Answer 
3.7% 



Petsonnel Have Other Higher- 
Lack of Resoiirces Priority Responsibilities 
, 10.2^* _> 1-2.0% , 



^ No, Federal/state Programs 
With Required Evaluation 



Other 
9.3% 



*Tl1^se "are percentages^ of total N. 



"I 



I 



TABLf: ^ 



erint^ndents: Do you receive Evaljjation Aasistance 
m agencies? 



State Department of Education 
BOCS or Intermediate Agency 
.Regiorial^Educational Laboratory 
Private Evaluation Agency. 
Educational Service District 
other 




mm. 




evaluations in only two percent of the cases. "^Qther" persons are partially 
<*esponsible 28% of the time. However , "others"* are hot Identified by the 
superintendents. ' * v ^ • ' \ 

As shown in Table 6, school districts more often get, ^valuation assistance 
from tfhftir state departments of education (59%) » This is true ^or all regions 
of the country except Regjion 10 (Alaskaf Idaho, Oregon and Washington) where 
75% of the responding districts receive help from their educational service 
districts most often. It is not cleai> from the survey responses, but these 
assisting agencies mav account for* sane of^^the "others" who are partially 
responsible for evaluations. 

Most superintendents rate the evaluations conducted in their district ad 
"t[ood" (54%) to "fair" (31%). Iji like manner, the, majority of schpol board 
members (85%) feel that the evaluation information' they receiv^ is presented 
in ^ manner which is useful/^o them. . 

When superintendents were asked what additional -types of evaluation they would 
like to conduct if sources were available, the' list was long. Generally, the. 
types, -fall into these categories - curriculum (basic akills and specif ic 
subjects), staff effectiveness, student achievement, graduate success, and 
business management procedures. Not aJLl superintendents responded to this 
item. Of tt)e 65 who did, 12 said th|it no additional evaluation is nfeeded^. 
One^said, "more of all kijjds." More time and personnel for evaluation and 
betrter knowledge of evaluatit)n techniques were also mentioned. 

Most superintendents (7?%) feel that information gathered through evaluation ' 
would help them cciiununicate better with their school boards. Twb ccxranents are 
irepresehtative - "The Board has^ to have information to make do6d,decigions," 
and "It would 'give the school board a clearer picture of ho^T^our staff is 
teaching and bow well the students are doing." Many superintendents who 
respondied negatively l;o this item Commented that their cOTununication is quite* 
good at presenjjt and additional evaluation information would probably make very 
little difference. ' / ^ 

The preceding ilata indicate that there is evaluation activity (broadly 
defined) tal^g place in small school districts. T!here is evidence that, in 
most cases, school boards have access to the infprmatibn. 

Most superintendjents (/0%) report that their school boeyrd requests information 
relating to program evaluations i The exception to this is in New England, 
where onl/^one out of the six school-boards make requests. These requests 
i;ang6 from various kindi^pf student achievement data demonstrating the l 
effectiveness of programs or instructional techniques to comparisons of orre's 
own district to others In the state. Some are formal requei^ts; others ate , 
casual, such as, "Well, how, are we doing ip math?" ' 

V 

As shown in Table 6, approximately the same percentage of school board members 
as superintendents report that they "^reque st e valuation information from schopl 
district officials (73%). Also, about 77Sr^f^board members report that they 
receive information yithout requesting it - 23.1% receiving it "often" and 
53/7% receiving it "sometimei^." Sixty-six percent of boards report theV do * 
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TABLE 6 



I 



~7 



Question . ' 



Does your School boerd request Information tbat relates to progranr*^ 
or program evaluation? ., . ' , 



Percent Responding 



Superintendents 



Yes 

m 



70. 0%'-.. 
26. A%- 



Does your school .board request program evaluation from school district 
officials? , ' • 



Board Memberfl 



Often 
Sometimes 
Seldom 
Never 



18.6% 
5A. 6% 
19.6% 
A. 6% 



(Yes) 
73.1% 



4 

. Do you receive program evaluation Information from ' Often, Sometimes Seldptn Never 
your school district without requestfing it? 23.1% 53.7% * , 13..0% 7.A% 



^ l8 the information from evaluations ^presented In^a Yes No .No Answer 

way that the Board flnde It useful? ' 85,2% 5.6% ' . 9,3% 



not have a policy for program, evaluation. Acoprding to conunehta, some have 
d^3r«gated the responsibility to«a currioulum review committee or to the school 
administrators' { Super i^jtendent an<Vor others and/or faculty). Of the 26% who 
do have policy, they conunent to the effect that It is a state mandate or a 
district pol^Lcy, ' None was willing to state Or enqlose a copy of the policy as 
the surveyjLequested. " ^ , 

The survey asked board ^members how their board uses' evaluation information. 
Results are presented in T^ble 7. The two biggea^t uses are to determine the 
future of on-going programs t65%') and to determine the- n«ed for a new program' 
(35%). • 

■ * 

When as.ked whether the information was disseminated to ^wirticular groups of 
patrons, ^Tightly less than half (47%)^ respond ••yes.? Most of the 
disiBemination is to parent groups, such as advisory councils, PTO's, iand 
boQster club», school staff' and th^ media. / 

Results indicate that information is disseminated most oljten at school, bbard 
meetings .(32^) and through the newspaper {27%). The school newsletter is also 
a popular metrhod for transmitting evaluation information. In some small 
districts, it is simply ••wQ|r^(3-of-nnQuth.^^ 

Those school^ board* members who feel the need for more program Evaluation 
information respond that the information would be helpful in making program 
decisions (51%) . Very few (2%) feel that it would be helpful in communicating 
with the community** « ' ' 

♦ ^- [ ... ^ 

Board members' estimates of the amount of time speltit on cucricultidfi matters is 
presented in Table •S. FQtty^wo percent estimate they spend 0% to 10% ojE 
their board time on curriculuIir^ 29% spend 11% to 25% of boa^d time on matters 
of instructional program. Less than; 10% of the board members estimate their- 
board spends mofe than 26% of time on curriculum matters* Twenty percent did 
not answer the question. The distribution of response is almo^st bimodal with 
24% estimating 10% of board time ^ purr icul urn and 20% estimating 20% of board 
time on curriculum. Since there ^ are 'curriculum matters which do not 
necessarily involve evaluation resultJi; it is assumed'^that the board time 
spent on curriculum evaluation is less\ than the estimates in response to this 
question. ; I ^ ^ 

Although 19% of school board members say they use program evaluation 
information to set policy (presumably in%curricular ar^pas) , ^^ut two-thirds 
of the board members (66%) say they do not have a poUoy to assure program 
evaluation. 



\ 



2b 

NWREL REP V 17 ^ ' J6891A 

■ • ^ / 2/28/80 



TAfltE 7 



Board Ude of Evaluation Information 



Determine Future Of Ongoing Programs 
Determine Need For a New Program 
Progress Report to Community Patrons? 
School District 'Personnel Decisions 
Set Policy ^ 
Other 



. Percentage 



64.8% 
35.2% 



17.6% 



17.6% 
18!5% 



4. 



TABLE 8 



V 



Wbat 'percent of its time do ypu estimate youi; board spe/ds oh currlculltia matters? 



Percent of Time 



P'erceht of Board Members Re^pondlpg 



1 to 3Z 
5% 
10%' 



20% 
- 25% i 
30%- 
33% 
40% 
50% 
60% 
No response 



f 3.7% 
13.9%' 
24.1% ' 
■4.6% 
20.4% 
3.7% 
4.6% 
.9% 
. /9% 
1.9% 
.9% 

/ 

20.4% 



C 



.19 



3n 



. . , Discussion 

■ ( ' ; , „ \ ' ■■ 

DefinitionallJ^r superintendents and board members tend to see, evaluation of 
programs as a monitqring'o^ on-going prpgtams arid student testing. Most 
progirams evaluated^ as reported by superintendents ^ we Title programs, which 
(are often Based only on student assessment. Other programs mentioned included 
tftatfe programs, federal programs , ^accreditation, district programs and « ' 
individual school programs. The extent of overlap is unknown. Standardized 
testing programs account for much program evaluation. For a survey such as 
this one,^it was not possible to probe how those^test results are used. One * 
may surn\ise>j^»; t^ge of possibilities from saylng'^^yes , we dOfit,-'? (and, the 
results are Somevmer^ in affile (jpllecting dust) to ex|ensi've examination of 
scores for students and for 'program- wide implications. Due to repotts by less 
than half of responding board members that regular evaluations are conducted, 
a. likely probability is that few small ^school districts do extensive 
examination of test scores for program impilcatiohs or revision. 

Personnel in small schools are limited in time and have to perform many 
duties. Seventy-five percent of the reporting superintendents reported a 
person responsible for evaluation. Only 40% reported a full time person 
responsible for evaluation, and that person does not necessarily devote fulj. 
•time to evaluation. Often a principal -or guidance counselor also has 
resj^nsibillty for the district's program evaluation. In most university 
^preparation programs for adjninistrators and for counselors, evaluation 
methodology receives little or no attention and testing very little (e.ven 
^though counselors are often expected to Interpret test score Information) . 
Only 59% of superintendents reported that the person in charge of eval^uai;ion 
had training in evaluation and it is not known what, type of training that 
might be. This paragraph does not intend to cast doubt on the competence of 
personnel responsible for evaluation in small school districts nor to ignore 
the value of learning b^'TrPtlte^ob experience. But it does intend to point / 
out the realities of a small schd«^ diistrict situation, with few people whos^ 
responsibilities extend, of necessf^, to many areas. 

An Indicator that curriculum or itsyevalu^itlon is nc^ high priority to schodll 
boards and superintendents is the amount of time board members estimate ' 
spending on curri<2ulum matters. Forty-two percent of responditig board members 
sayc their. boards spend 10% or less of their time on curriculum \natters>/at 20% 
or less time, the percentage of board members goes to two-^thirds (67%)/ The^e 
results are consistent with an NSSA survey' published in spring of 1979 in / 
which board members from districts of all sizes estimated spending about six' 
percent of board time on curriculum^ Data gathered informally in workshop ' 
situations with board members <fin the Pacific Northwest states during 4979 * 
would also Support the time estimates gijy^en in the survey*. In addition, at 
workshop sessions, school board members from some small school districts 
reported they feel less need for evaluation information on a formal basis 
because they were in the schools often; they evaluate subjectively 
themselves. They also are in close touch with a small community and know how 
their community feels about the schools. \ ' ^ 
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While school, board members and- superintendents jigree that they •'need*' 
evaluation information, apparently program evaluation is a fairly low 
priority, because their personnel hlsiye other, more important responsibilit^ies 
and the amount of time given to program evaluation of curriculum matters. As 
noted in the preceding paragraph \he amount of time'spent by boards on 
purriculum is not restricted to small school districts. The largest 
pifoportion o^f evaluation conducted in smill district, according to the ' 
superintendents*^ are the titlip programs, that is, those whied have mandated 
evaluation, • . 

* • \ 

{ 

It must be remembered that school' board members aie voluntarily contributing a 
great amount of time and effort to serve on the school board/without pay (in 
most states), • ^j* 

Going back to the survey data, not quite half cA the ^responding^ 1x)ard members, 
are satisfied with the situation of program ev^uation. Slightly more than' 
^ half want more evaluation information. The board members &ay*^hat those ih 
charge of evaluatiqn have higher priority responsibilit1(.es;pr there are no. ^ 
resources^ It ila the School l^oard, however , tha^ allocates resources. Most 
states' .la\Ste, codes, or constitptions state that a priht^ry responsibility of 
the governing bo^rd of a school .district is to provide a coursie of study or 
curriculum or educational program for the students in that dist/ict. School 
districts can and do receive assistance ^on evaluation, including state 
departments and intermediate agencies of various types. 

Board members indicate that information is provided to them in ways which are* 
useful. Their uses of evaluation are-mainly those concerned with decisions 
about programs; whether to continue or change existing pi^ograms (65%) and 
determining need for new programs. Decisions about personnel (presumably 
addition or reduction in general rather' than individual) are another type of 
decision which program ^aluation aids,. School board members ipake progresi^ 
reports to their community and disseminate information through .various means, 
but primarily through school board meetings and newspajJers, Two 
representative. comments made by school board members are as follows: * ^ 

"I feTel evaluation is an imporUnt tool to be used by the administration and 
board to help promote and further good education in a school district, I also 
believe that it is thfe re^sponsibility of the administration s^ff to handle 
' this matter and to give the board that information which they feel is of 
importance - unless specifically asked by the Board for information, A Bp^d 
of Education cannot have the time available to access evaluations in depth and 
must depend upon a responsible administrat^ive staff to l^eep them informed of 
problems qr good points concerning on-gO^ng evaluation programs, 

••We as a Board, do our curriculum studies, or evaluation, through our 
Educational Nei^ds Committee, This grpUp meets once a month (in addition to 
our regular monthly Board Meetings) td dPiscuss curriculum and divaluation of^ 
same. Our middle/high school opened in 1972, The school was evaluated by the 
New England Association of Schools and Colleges in 1974 an<3 was accredited for 
five years, receiving an up-date and extension jc^f this past year. These 
0 pifocedures ensure constant watchfulness on part of school and Boarc^ regarding 

••« 

NWREL REP 1 ' 21 <^,^ > 6891A 

, ^ , . 2/28/80 



•^valuation. We have a close working r el cations hip between our Board and 
Adminij9tration - and staff members meet with the' Ed, Needs Canmi'ttee 
frequently and willingly as we dellre irtto the various aspeqts of the program' 
pn a regular basiiS, 1 hope this h^s been helpful. * ' . \ 

Superintendents^ however^ rate the'' evaluations as good to fair^ and ^ke. many 
suggestions as to^ additional types o& evaluation needed. by the district, most- 
relating to curriculum, ^bat* some going beyond the survey quesions about 
program evaluation into areas such as certified and non-certified ^personnel 
evaluaraon^ imd board self-devaluation. ^ ' 

Many school board members want mdre program veyaluajkion Information (51%); they 
feel it. would be useful^to ihem in mailing' pro^iPaindecisions^ and to some Extent 
ooiftrouni eating with thefr (jommunity. They find evaluation infcimation 
presented to them to be useful, particularly in monitoring programs. Yet, 
almost two thirds do not have a policy for program evaluation' Policy setting 
has long been ext<)lled as a primary responsibility and .vehicle for the schqol 
board to accomplish its goal for the school district. Certainly, iiE board 
mCTibers want evaluajtiion, they can set policies to assure that program 
evaluation will occur. 

, r. 



4 
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Sununarjj 'and Conclusions 



This study confirms the need and desire for program evaluation. information by 
school boards and superintendents in small school districts. Program 
evaluations are conducted in»mQSt-of the districts surveyed^ although the 
depth an(Vor regularity with ^kihich they ?re conducted varies widely. Pi;ogram 
evaluations In ^all distriits rely greatly on student test/achievement data^ 
and they also receive help from outside agencies inl inducting or a)mpiling 
the. information. The board receives the information in most cases; t^y may 
red(uest the information in a.juajonlty of districts/ or they irfay receive' 
information unsought. In either case^ .they **wel come the InfoHnation- and use it 
to monitor ongoing programs^ and to maka program decisions. Many school board 
members are 'satisfied with the amount of program evaluation in their 
districts; more than^half want more program evaluation. HoweVer^ curriculum 
and its evaluation doe6K^ot\ command much board time^ and many boards do not 
have policies tj^o assure ±he prograta evlauation they say that they want'./ 
Boards and superintendents dissemifnate the information the^ have cJn program 
evaluation at board meetings andythrough newspapers and newsletters. In'many 
respects these results-^Sffe\not s/irprising. They are not greatly different 
from largtfP districtsl who irkevnse do not spend much bbard^time on ' 
curriculum. The^L-wifsh had more program evaluations and the time to utilize 
student test-'^ta to monitor continuing programs. * • 

Many questions are left unanswered by a survey of this teype. Even though the 
school districts were idjentitfied on a random sample basis, their 
representativeness of small schools across the cotfntry is not known.* Many 
probing questions to follow responses from survey f ormiC must be left unasked. 
The hindsight with whieh ope clearly sees y/ays to ask better questions or to 
add anot;her pertinent question cannot now be incorporated into this 'particular 
survey. % \ 

OYerall, there^eems to be a positive reception of and at least intended use ' 
of what program evaluation information is available. Prom authors whose bias 
values program evaluation for the decision-makers of school district, 
congratulations to' bljose districts who, in spite of limited resources, time 
and number of personnel; find ways to carry. out and use program evaluation. 
One hopes that others will f ind' creativa^ ways to gather and the interest in 
-using program evaluation for the improvement of the districts. A final note 
of author bias would say to bhose developers of evaluation methodology, that 
in the quest for ever more sojrfiisticated ways of- analyzing and desigfjing / 
evaluations, it is hoped that the needs of the small and/or rural schoo^ ' 
districts '^re not forgotten. 
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If your Stat, hat laws or ragulatlons about program avaluatlon, please attach copies 
If .ivailable. If you do not have coplea, but Hqow that auqh laws exist, please 
check hera: » / 



Please ua« this space co aiaka any additional comments about- evaluation or the survey 



VoM conVUbuUon <o (|u4 lUofU It w«a| g/ito^ app\(U(im. uou wooW tifee a 
iurmoAy oi xtAwUS pUiui pxiM youA nmt and add\tAi\n thz back oi ihz /ic^n cwtCope 
•l.wr on tluA qutttttontuuAt) . We wctt 4|ie that yoa gtf:)u. ' 



KEYS TO SCHOOL 
BOAKDSi\tAINSHIP 



.EMC 
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PROGRAM EVALUATION SORVEY FOR BOARD MEMBERS 

We ar« trying td determine tTie evaluation needs and/or uses ot evaluation 
Information of school boards In small school districts. Your help In 
. completing this <jues^;ionnaii;e is greatly appreciated. Please circle the 
number ot your response* 

C^•l. What does school or proqran evaluation mean to you? ' ^' 

1 ACCOUNTABItltY? ^ , 

2 . CONTINUOUS MONITORING OF ON-GOING PROGRAMS? 

3 DECISIONS rOR CONTINUATION, OR TERMINATION? 

4 ASSESSMENr\OF STUDENT PROGRESS? 

5 COMPARISON OF DIFFEilENT TYtES OP PROGRAMS? 

6 OTHER? ' 0 



0-2- Does your district conduct curriculum^ evaluations? 

1 YES, REGUtARLif : ^ . 

2 ' YES, TO COMPLY WITH FEDERaI/BTATE REGULATIONS ONLY 

3 YESv SOMETIMES 

4 ONLY IN UNUSUAL (JlRCUMSTANCEs" 

5 NOT AT ALL 

6 i DON'T KNOW AT THIS TIME > 

■y 

0-3. ppes your school board request program evaluation Crow', school 
district officials? ' , - ' ^ \ 

1 OFTEN 2 SOMETIMES ' 3 SELDOM 4 NEVER 




l^OTON .'a soVeriMM 3^|tU)0H'' 4 NEVER ' ' 

■th « v«y that th« Bo«d (indi U^u.«ful7 

• * • • « 

. i YES 

NO . ■' '\ : 

;<H; «1~ do*, your .chool b4rd us- th. ,v.lu.tlon Information? / - " 

T . DipTEWlINE THE ftmWB Of ON-GOiNG PROGRAMS . . , ' ' . 

2 BeraHmtm HEKe por a new program , • , 

J PROGRESS REPORT TO COMMUNITY PATRONS ^ 

• > - 

.4 SOrOOI. rilSTRICr PfeRSONNEL oecisioNs \, - ' 

5 -SBT POLICY , s 

* OTHER . ■ 



tfi> 



.'■ >^ — " • ' 

-'^f^ ^n'o^-ion to.pa.ticul.c 



1 YES^ 



2 MO* 

If yea, to what groups? 



■ V 



.1 



- If ya«, how in thu Infornmtlon <^|aaaialnatfd7 

2 OqMMUHlTY MEISTIMGS v> 

3 SOIQOL ^OMU) MBETIHOS ^ 




5< 
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\ ^ Information, would thl. kind of Information be helpful "to you 

I ^ IH MAKING PROGRAM DECISION*? 

2 IN COMfJNiCATING WITH THE COMMUNITY? > < 

'3 ' ' . * , 

1 MORp 

2 .LESS . / » 

^« 

3 SATISFIED WITH'pRESm?r AMOUNT 

<■ 

i I^CK or RESOURCES ^ • ' 

r PERSONNEL HAVE OtHER BIGHER PRIORITY RESPOMS IB ILITIES 

3 NO nSDERAL/STATE PROGRAMS Hli^ REQUIRED EVALUATION 

< OTUERi " ■» 

' ' — , . 



x 



Do you hava a policy Cot program avaluatlon? 



2 MO 

If yaa, ploaaa statat 



Q-U* ^ SUta in which school dia^ let Is locatadi 



^^^^ J '^PP^^'^Awata nuinbar of atudant^ in school dlatrlctn 



500 or laaa 



500-1000 



loop- 1500 



Mt)rtt than 1^09 
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ch«Gk 



sp«c. CO uk. any additional coi«nBani|3 jjouc avaiuacion or th> 



rie survey. 



I. 



>l| \^tuAn envelope 



ERJC 




TO SCHOOL 
BOARDSiVtAlVSHII' 



P ROORAM EVM.UATIOH SURVEY TOR 9tn>ERINTp<DEWT3 

HfhS; JllirLJ^ J«ter»l„, tha .v.lu-tlon naad. and/or pr.ctloa- of 
^n-^r ''^"f'^'^f" 1" ^-^lo"- Ifour halp In co«,platl„q this 
r-:;^laT " -ppr.cl-tad. Pla«a ^ll^la thj „u«^ar o, your 



0-1. What do€a avaiuation mean .to you? 
ACCOUNTABILITY 

CONTINUOUS MONITORING OP* ON-OOINO PROGRAMS? 

DECISIONS rOR CONTINUATION OR TERMINKtION? 

ASSESSMENT Of STOOENT PROGRESS? 

COMPARISON OF DIFFERENT TYPES OF PROGRAMS? 
OIUffiR?^^ ^ 



i 

r 

3 
4 

5 

L 

6 



^2. What typea of evaluation are conducted In your diatridt? 

^ i FEDERAL PROGRAMS? 

2 TITLE PROGRAMS 

3 STATE PROGRAMS ^. 
i * ACCREDITATION 

5 PISTRICT-WIDE PROGRAMS 



INDIVIDUAL SCHOOL* PROGRAMS 
NON& 

orriE R 




'^3; Do\ou hnvtt a dl*trlct-wia« atanaardiked taatlng program? 
1 m 

' 2 NO 

^ ir so, WHAT TESTS MUS W)mNlSTEWSD7___ 



<9 



TO WHAT GRADES? ' |_ r ^ 



0-^ Do you hava a nt^tt parson in yiim-Tllatrict ceaponsibla for your 
•valuation*? * ' 

1 YES 

2 ' MO ' 
It yaa, is ha/sha 

\ 1 FULL TIMR » 

2 PART TI^f!^ 

If part tima, Is ha/shai 
• 

1 CLASSROOM TEACHER? ^ ^ 

2* PRIWCIPAL? 

3 QUIOAHCE COUNSELOR? • 

4 OTHER? 



Is th« parson trainad In maasaraAatit an^ovaluation? 

1 nss , . 

2 MO ' f 

Hov affactiva do you connidarthe evaluations conducted In your 
distriot? 

1 KXdXLEMT ^ 

2 GOOD 

, 3 rAi| 

. 4 POOR ' ' 



5 my-fooR 

T 



ts thaia 



0-6, in tha^a a« tqailcy froia whm you gat evaluation assistance?' 
1 ^ STATE DEPARTMENT Of EDUCATION 
^ 2 aqCS OR OTHER tKrERMBOlATfi AOtfNCY 



43^ • ^ \ 



3 . REGIONAL EDUCATION LABORATORY 
i ^PRIVATE EVALUATION AGENCY 

5 EDUCATION SBRVltE DISTRICT 

6 OTHER ' 



0-7, , If sour ces Hire available, what adctitional typas of evaluation do you 
^w*. feel your district needs? ' 



Q-8. Does your achool bpard request information that relates to prograins 
or prograra evaluation? ^ } 

. 1 YES 

VYh^^' .no . ' 

. ^ Give 4n example I 

4 

0-9. If you had Iniormation gathered through evaluation, would it help vou 
communicate with your school board? ' . • 

* 1 YES 
. 2 NO 

Pxplaint ^ • 



State in which School District is locatedi 
No. of Schools ' 



Nq« of Teacher s_ 
Nb« of Students 
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Appendix B 
Number of Districts 



i 



I 

V 
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«• ' • * 

X ' . ■ " . 



NUMBER OP DISTRICTS BY STATE & HEW REGION 
WITH STUDENT POPULATION OP 1,500 OR LESS ' 




1 



DiAJ^m, fOlSt • 


# Dipt. 

in REGION 


% of 
Total , 


« Dist. 
in Sample y 


/ ^landom 
Rumple- « 


Connecticut " 60 
Maine 202 
Massachusetts 149 
New Hampshire 122 
Rhpde Island 9 




/ 


/ 

/ 

r 


\ 

\ 

\ ■ 

• 




790 


8,7 


26 . 





New Jersey 321 
New York 303 








\ 


REGION II TOTAL 


624 


6.9 


20 


30 


Delaware 2 
Maryland _ 4 
Pdnnsylvania ' 70 * 
Virginia lo 
west: Virginia- 1 










REGION III TOTAL 


109 


1.2 


4 


27 


Alabama 13 
Florida 5 
G^rgiia ' 24 
Kentttbky . 32. 

i^urun waroiina o 
South Carolina 16 
T0nne88ee 32 


f 

\ 

9 

\ 


; 




■ ' r 


REGION IV TOTAL 


ieb 


1.8 


' 5 


32 


1XaI.XIIi.IXo / lo 

Indiana ' QO 
Mi(Chigan 182 
Minnesota 314 <- 
Ohib 187 
HiBconain 284 


^ . 


t 


/ 




REGION V TOTAL 


1773 


19.6 


59-^ 


' 30 


Arkansas 312 
N«w Mexico 54 
Oklahoma 564 
Texas. fti7 


♦ 






♦ k 


REX3I0N VI. TOTAL 


1747 


19.3 


18 


, 30 ■ 



NWREL «'HBP 



i 



V 

••I 
* • 



Qrn&rnfli Jin 4 «i. 
oXAlljS ffDlSt • 


ff DISC, 

In REGION 


% oc 
Total 


. # Dist, 
In Sample 


Random 
Sample # 


Iowa 361 
Kansas 249 
Missouri 419 
Nebraska 397 






« 




RBX3I0N VII TOTAL 


4426 ^ 


15^ 


47 


30 f 


^oior aco 132 
Montana 383 
North Dakota ' 306 
South Dakota 172 

Tif Ah 1 A 

wyoininy 35 


* 

* t 

\ . 








REGION VIII TOTAL 


1042 


11,5 


34 


30 


Arizona 160 
California 635 

N6Va«la 8 










REGION IX TOTAL 


803 




26 


30 


Alaska 23 
Idaho 79 
Oregon 262 
Washington 198 










REGION X TOTAL 


562 


6.2 


19 


30 


GRAND TOTAL ^ 


9036 


99.9, 


298 





\ 



)- 



NHREL RBP .. . . ^657A 



47 ' * / 



' 9/18/79 



SURVEY RESPONSE FROM SUPERINTENDENTS 



, 1 








w 




Region I 








Poo-f on \/T 

tvegxon Vi 




Conn PC t Ini ^ 


1 

X 




< 

> 


Arkansas 


8 


Maine 


1 ' 






* , 

UKianoma 


13 


Msssac hiis p 1 1 s 


9 
z. 






rfi »v j-i 

iSxas 


14 


New Hamnshlrp 

4 ' ^ I *^ lilt/ O 1 1 A. 1, c 


1 






New Mexico 


2 


Rhode Island 


0 






Total 


37 


Total V 






If 














Region VII 












Iowa 


9 


New York 


Id 






t\.ansas 


9 


New Jersev ^ 


11 






Missouri 


9 - 


* Vermont 


1 

X 






iNeurasKa 


12 


Total 


99 






Total 


39 


♦ Rpff "f nn T T T 








1 

Region VIII 




Ppnriflvl \7^in'f a 

J. Cltitojr X V dilXd 


o 






Colorado 


4 


VtrKinla^-^ 


1 

X 






Mofltana 


10 


Total 








ut^n 


0 










NoTtn Dakota 


7 










South Dakota 


^ A 


Region IV , v 


✓ 






Wyoming 


2 


Georc i a 


1 

X 






iotai 


27 


Kentiiplcv \ 


0 










M-l a d *t a a "1 n n "f • 


1 

X 










South Caroling 


0 






\^ckCtA r\r\ T Y 

xvegxon XA 




, Tennessee 


0 






Arizpna 


4 




n 
u 






California 


16 










Total 


20 








- 






Region V 








Region X 




Illlnbls 


19 






xu. emu 


<i 
J 


T no a n 23 
XilUXcillct 


0 






Oregon 


7 


\ Micnlgan 


s 5 






Washington 


8 


Minnesota 


9 ■ 




) 


Total 


18 


Ohio 


6 




. ; 




Wisconsin 


4 






« 




Total 


.45 




I 
f 


Total for All Districts: 


218 







































SU.RVEY RESPONSE FROM SCHOOL BOARD CHAIRS 



Region I 
Connecticut 
Maine 

Massachusetts 
New Hampshire 
Rhode -Island 
Total « 



E^egion II 
New York 
New Jersey 

' Vermont 
Total . 



Region III 
Pennsylvania 
Virginia 
Total 



Region IV 
Georgia 
Kentucky 
Mississippi 
South Carolina 
Tennessee 
■Alabgmaj, 
Total 



Region V 
Illinois 
Indiana 
,Michigaii ' 
•'Minnesota 
Ohio 

Wisconsin 
Total' 



1 
0 
0 
0 
0 



9 
2 

0 



11 



0 
0 



1 
1 

• 1 

0 
0 

_0_ 
3 



10 
2 
2 
6 

5 

6 
31 



Region VI 
Arkansas - 
Oklahomat 
^ Texas 
New Mexico 
Total 



Region VII 
Iowa 
Kansas 
Missouri 

. Nebraska 
Total 



Region VIII " 
Colorado 
Montana 
Utah 

North Dakota 
South Dakota 
Wyoming 
Total 



Region IX ' 
Arizona 
California 
Total 



Region X 
\ Idaho 
Oregon 
Washington 
• Total 



6 



2 
1 

5 
3 



11 



1 

5 
0 
4 
3 
0 



13 



2 
9 



11 



1 
6 

6 



13 



Total for All Districts: 'll3 



\ 



# « 
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. Letters and Post Card 
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October 25, 1979 



Dear : * 



As part of a project to develop continuing education materials, for school . 
boardj members (KEYS TJO^SCHOOL BOARDSMANSHIP) , I am involved in developing 
workshops about the\schpol board's role in program ev^iluation; Looking at . 
progtam evaluation, I find that very little information is available about, 
what evaluation information small school districts have, , need or use. In 
\ort3(ir to bulla a set of materials which are really useful for school boards 
and superintendents, I need to know if you conduct evaluations in your 
district, what types of evaluations you do, and how that Information is used. 

The two key people whom we feel would be most knowledgeable in this area are , 
the School Board Chair and the Superintendent. Your district is one of a 
small number of scliool distclctvs in 10 regions of the entire country which has 
b^pen selected ^t random. In order for the survey results, to ?^ccura%ely reflect 
the thinking of school boards and superintendents across the count^ry, ,lt is ^ 
important .that you complete the enclosed survey. " ' ' 



You may be assured of complete cohf identiai4^y. The survey has an Identif IW 
cation nurabei? for mailing purposes only. Thjlfs is so that, we may checV your 
name bff >of the mailing list when your questionnaire is^ returned. Your name 
will never be placed on the questionnaire. |The information will be compiled 
from the total sample, and there will be nothing in the results which would 
identify you or your district. , 

" i, ■ ■ ' ■ 

The results of this research will be made available to .state sc{)ooi board" " 
associations, to our project staff, and to other-r groups oc organizations 
interested in small school districts. You may receive a suran^y of the ^ 
results by writing "copy of results requested" on the back of the feturn 
envelope and printing your j name and address below It. Please do /not put th\ 
IrtEOfmation on the survey itself, ~~t^ 

-I' jffbuid be -very happy to answer any questions you might TmVeu Please writ^ or 
.^caTl. The t^ephone number is (503) 248-6844. Thank you foj your asslstanci". 



Sincerely, 



> 



Elizabeth A, Tpmblln, Ph.D. 

Keys to School Boardsmanshlp Project 



BTrlb 
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->La8t week a queatlonnalre seeking your opinions about program evaluati^on in 
yoiA school district was mailed to you. Your name was drawn in^ ran™ 
sample. o£ school districts throughout the, country. Ji- 



lt you have already completed' a ncl returned it to us, please accept our si)leere. 
thanks. If not, please da so today. Because it haa been sent; to only a 
^mall, but representative ^wnp.le of superintendents ajid School Board Chairs, 
it Is extremely important tlht yours also be included 4n the study if the 
results are to accurately represent the opinions of each group. 

If by some chance you did not receiye the questionnaire, or it got nhrtiplaced, 
please call me right now, .eoll^ct {5p3-248-^844) and I will get another pne In 



the fflall to you today^ 
Sinbi^rely, 



, ♦ 



Elizabptlr Tomblin 

Keys to School Boardsmanship 



I 



V 



November 5r 1979 



Dear: 



About three weeks ago 1 wrot^ ta ^ou s^ejdnc( information about program' 
evaluation in your district. As of todayWe, have not received you completed 



qyestionnaire. 



The Keys. to School Boardsmanship projedt is- doing this study, because there is 
such a scarcity of information about f)ro^am evaluation iii small school* 
districts. We »ife trying to' develop mhta^ials about curriculum and its 
evaluation for school board members in^all school districts. The survey 
Inforraaton Is vital to the developmefiv^f. appropriate materials in these areas. 

pur sample was drawn randomly from small school districts in the nation. The 
number of small school districts in each region is &o sm^ill that your survey 
may be the only one, or one oiE "very few, from your state. In order for the 
study- results to be representative of those superintendents a n<^; school board 
chairs^ in each area, it is essential for each person to return his or her 
survey. If' your: directory did not give us ypur (^^rr.ect name> but you 
presently fulfill the position of supeeintendent or school-board cfiadr (or 
were schpbl board chair during the previous year) , please complete' the 
survey. . If you , are requesting results, please be sure your correct name and 
tid^XeBS is on the envelope. * ' ' 

,. ^ ^ ■ •■ ' . 

Itii the event your questionnaire has been misplaced,, a replacement is ' 
enclosed. Your cooperation is greatj^y appreciated. ' *. 

'Sincerely, "- . \ . ■ . y . 



Elizabeth Ap Toftiblin, Ph.D. 

Keys' to School Boardsmanjship-irojecy 



